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ABSTRACT 

A field test vas designed and conducted to examine 
the effectiveness of Arizona- designed career education units, 
particularly to examine the units' success in terns of their ability 
to affect positively students* cognitive, affective, and psychomotor 
behavior according to expressed performance and behavioral 
objectives. Fourteen career education units in nine projects were 
field tested. Data were gathered through UNIVAL, a panel review, and 
a community review, with approximately 5,000 students and 174 
teachers included in the study. Of the students, 51 percent were 
female and 49 percent male; 61 percent were Anglo and 39 percent from 
minority groups. Of the teachers, 54 were sale and 120 were female. 
Teacher attitude toward career education vas fairly high and 
moderately positive toward the particular units. Student response to 
the units was positive, and learner performance vas a high 80 
percent. Measurements for each unit were calculated, based on teacher 
attitude, learner attitude, and learner performance. Student 
demographic data were subjected to an ethnic profile, and 14 cost 
factors analyzed for each unit. It was concluded that all 14 units in 
the field set were sufficiently satisfactory to be included in the 
1974-75 statewide implementation program. (AG) 



CD 

US DEPARTMENT OF HEALTH. 
C J EOUCATlON ft WELFARE 

NATIONAL INSTITUTE OF 
EOUCATlON 

THIS OOCUMENT HAS BEEN REPRO 
. . OUCEO EXACTLY AS RECElVEO PROM 

i I ■ THE PERSON OR ORGANIZATION ORlGlN 

ATlNO iT POINTS OF viEW OR OPlNtONS 
STATEO 00 NOT NECESSARILY REPRE 
SENT OFTICIAL NATIONAL INSTITUTE OF 
EOUCATlON POSITION OR POLICY 



FIELD TEST REPORT 
Vol. 1 

ALL UNITS 

Frank L. Viclno 
James S. DeGracie 
Chris Downs 
Don Peterson 



ONE OF A SERIES IN THE 
ARIZONA STATEWIDE FIELD TEST 1973-74 



(J^ Conducted by 

S» THE DEPARTMENT OF RESEARCH AND EVALUATION 

f>j Mesa Public Schools 

J Dr. George N. Smith Dr. James K. Zaharis 

(N superintendent Assistant Superintendent 

0 Administrative Services 



0 



for 

THE ARIZONA STATE DEPARTMENT OF EDUCATION 



Dr. W.P. Shof stall, Superintendent Eugene L. Dorr 

Arizona Associate Superintendent for 

Department of Education Career Education 



A STATEWIDE UNIFIED 
ASSESSMENT OF 
CAREER EDUCATION UNITS 



^Coconino 



^Yavapai 



S^WACOP 

'ft Roosevelt 
"Ar Mesa 
^DICE 



^Pinal 



*Tri- 

County 



St Santa Cruz 



FOREWORD 



So many have contributed major input to the field test 
processes of unit delivery , monitoring, instrument completion, 
panel reviews, and community reviews, that it is impossible 
to extract, note, and applaud individual efforts. I am sure 
that all those involved in this major team effort can see 
how much has been accomplished and have a positive view of 
its educational significance for the young people of Arizona. 
By documenting and analyzing the capabilities of the career 
education units tested, we all have contributed a positive 
boost to career education in school districts across the 
state. 

The task of Field Test Manager has been simplified con- 
siderably by excellent staff support from the Mesa Public 
Schools Department of Research and Evaluation, responsive 
assistance from the State Department of Education, and the 
effective management shown by the field test coordinators 
from the respective field test projects. 




Frank Leo Vicino 
Field Test Manager 



JUNE, 1974 
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PREFACE 



*his is one of a series of field test reports on 
Arizona developed Career Education Curriculum 'jnits. This 
report presents information concerning overall field test 
rationale and compilation of results for all field tested 
units. Other reports in this series contain unit specific 
field test material. 



The work presented and reported herein was performed 
pursuant ™ contract from the Arizona State Department of 
Euon. However, the opinions e ^ e8 ^^ e ^ e n ^? z S n a 
necessarily reflect the position or policy of the Arizona 
state Department of Education and no official endorsement 
by the A^izoSa State Department of Education should be in- 



Executive Summary 



Objectives 

In an effort to examine the effectiveness of Arizona 
designed career education units, a field test was 
designed and conducted. The field test was designed 
to examine the success of the units in terms of the 
unit's ability to affect positively, students 1 cogni- 
tive, affective and psychomotor behavior according to 
expressed performance and behavioral objectives. 

The field test of the 14 career education curriculum 
units was conducted across the state in the following 
nine projects: 

Coconino Santa Cruz 

DICE Tri-County 
Mesa WACOP 
Pinal Yavapai 
Roosevelt 

Approach 

Basic unit data was collected by the use of UNIVAL, 
an instrument designed to garner student/ teacher demographic 
information, student/teacher attitude, student unit perfor- 
mance, and unit cost. Another evaluation strategy called the 
"Panel Review" was used to gather in-depth unit refinement 
data. The data analyzed was from approximately 5,000 stu- 
dents and 174 teachers with the following general results. 

Results 

1. A total of approximately 5,000 learners were. exposed 
to the units in the 9 participating projects. Fifty- 
one percent of the learners v»;-?re female, and forty- 
nine percent male. Sixty-one percent of the learners 
were Anglo with thirty-nine percent from minority 
backgrounds . 
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Executive Summary 



Of the 174 teachers that presented the units 54 
were male and 120 were female. The median years 
of experience was between 6-10 years and 45 had 
previously taught or developed a career education 
unit or program. 

Teacher attitude toward career education was fairly 
high (3.91 on a scale where 5 was the highest pos- 
sible response) . Of the 348 possible responses/ 
78% were positive , 16% were of no opinion, and only 
6% negative. 

Teacher attitude toward the units — the teachers were 
moderately positive overall toward the units (3.51) . 
Of the possible 522 responses, 67% were positive, 
8% were of no opinion and 25% were negative. 
Teachers that had a high positive attitude toward 
career education appeared also to favor the units 
(r » .95) . 

Learner attitude was positive toward all units 
across all projects (2.5 on a scale where 3 was 
the highest possible response) . Sixty-three (63) 
percent of the 31,398 student responses were posi- 
tive toward the unit, 25% no opinion, and 12% 
were negative toward the unit. 

Learner performance on the unit — the overall percent 
of correct scores for all the units by all the pro- 
jects was a high 80%. There was little variation 
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Executive Summary 



across projects. 

8 Measures of unit effectiveness based on teacher 
attitude toward the unit, learner attitude toward 
the unit, and learner performance on criterion 
referenced lesson imbedded items were calculated for 
each unit. A ranking of the units in terms of unit 
effectiveness is presented in the report. 

9. Student demographic data from the field test site 
were subjected to an ethnic profile. The units' 
effectiveness were re-ranked in relation to ethnic 
profile, so that districts with comparable ethnic 
profiles could use the information for implementa- 
tion decisions. 

10. Cost Analysis — fourteen cost factors were examined 
for each of the units. Two cost factors, teacher 
time and teacher planning time account for 90% 

of the cost of implementing the unit. The mean 
per pupil cost per project was $4.63. 

11. Unit effectiveness rankings (with double weight) 
and cost rankings (with single weight) were combined 
in order to re-rank the units in terms of a cost 
effectiveness measure called unit value. Rankings 
for each unit for unit value are presented in the 
report. 
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Executive Summary 



Recommendat i ons 

1. All 14 units which were field tested are satisfactory 
enough to be included in the 1974-75 statewide imple- 
mentation program. 

2. It is recommended that an attachment containing sug- 
gestions for refinements, listed in the individual 
unit reports, be attached to the appropriate units 
for use by the implementation teachers. 
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INTRODUCTION 



The major purpose of most innovative programs such as 
career education is to affect positively students' cogni- 
tive, affective, and psychomotor behavior according to ex- 
pressed performance objectives. 

The present field test was designed to determine the 
extent to which the performance objectives have been met by 
the Arizona-produced career education units. A secondary 
purpose of the field test was to provide data which could 
be used to refine the units and assist in determining imple- 
mentation strategies. This information is intended for the 
curriculum staff at both, the State Department and partici- 
pating sites which ultimately will be chosen to implement 
the units. 

Mesa, as Field Test Management site, was responsible 
for the development of the field tdst instrument package and 
the general monitoring/managing of the field test. The 
major responsibility of the Field Test Management site was 
to reduce and analyze all data received from those projects 
field testing career education units. Other responsibili- 
ties included the conduction of a workshop for the local 
field test coordinators, and on-site interviews with instruc- 
tors, administrator*, parents and community business people. 
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Sites across the state were chosen to field test se- 



lected units. The following projects were involved in that 



effort: 




1. 


Coconino 


2. 


DICE 


3. 


Mesa 


4. 


Pinal 


5. 


Roosevelt 


6. 


Santa Cruz 


7. 


Tri-County 


8. 


WACOP 


9. 


Yavapai 



The following list presents the titles and grade levels 
of the units tested in this field test. 

GRADE 



UNIT LEVEL TITLE 

107 2 What Do Workers Do? 

Ill 6 Careers Calling 

210 5 Developing Your Potential 

211 6 Ideas: Things to Think About 

310 5 The Future Me 

311 6 Now and Then 
605 K Tools for Toil 

610 5 Giving and Following Directions 

611 6 Skill Schemes 
709 . 4 Doing Your Thing 

805 K Reading, Writing and Numbering 

811 6 Look to Learning 

3026 10-12 Typing Correct Business Letters 

from Shorthand Dictation 

3768 7-9 Instructional Unit in Composition 

of Business Letters 
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MESA'S MANAGEMENT ROLE 
'IN THE 
FIELD TEST 



In order to insure the efficient, timely and orderly 
flow of the field test a PERT network outlining activities 
and parallelisms was constructed and served as the basic 
management instrument for the conduct of the field test. 



SELECTING THE UNITS, 
INSTRUMENTATION, AND THE 
DETERMINATION OP THE 
SAMPLING FRAMEWORK 



The State Department (through the Research Coordinating 
Unit) utilized a unit selection procedure (criterion check- 
list) which resulted in the selection of 14 units. 

In conjunction with representatives of the State Depart- 
ment, units were distributed to the nine sites using the 
following instruments to reflect proper sampling and to take 
into account the project's preference. 

a. Field test site description 

b. Project preference sheet 

c. Random selection procedures (constrained by 
geographical distributions) 
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FIELD TEST 
INSTRUMENT 
DEVELOPMENT 



Field test instruments were developed by Mesa's 
Department of Research and Evaluation, sending working 
copies to the State Department for review and critique. 
A Unit Evaluation instrument package (UNIVAL) was completed 
soliciting demographic, impact, cost and assessment data. 



FIELD TEST 
COORDINATORS 1 . WORKSHOP 
AND 

MANUAL DEVELOPMENT 



On September 18 a. Field Test Coordinators 1 Meeting 
was held. The agenda included the following topics and 
presenters : 



Introduction 
Introduction 



AGENDA 

Why We're Here 
R.C.U. Role 

Field Test Coordi- 
nators 



Introduction to Field Testing, Moni- 
toring Site Role, Timelines, Trial 
Run of Field Test 

Field Test Coordinators 1 Role and 
Responsibilities; Manual, Tracking 
and Administrative Cost Forms 

UNIVAL Instrument 

Questions and Discussion 



Beverly Wheeler 
Bevarly Wheeler 
Frank Vicino 



Debra Vild 
Jim DeGracie 
Beverly Potter 

Debra Vild 

All 



The major document used in the Field Test Coordinators' 
Workshop was the Mesa developed Field Test Coordinators' 
Manual. The workshop covered the various role demands of 
the field test, instrument usage, and instruction for in- 
servicing field test teachers at the various sites. 



EVALUATION 
OF 
WORKSHOP 



An instrument to evaluate the workshop was designed by 
Mesa' Department of Research and Evaluation and administered 
to the field test coordinators. The results of the evalu- 
ation were presented to the State Department in a previous 
report. To summarize the report: 

...The workshop participants felt that they attained 
the major objectives of the workshop. 

...The procedures used by the presenters assisted the 
participants in attaining the objectives. 

...The objectives were important. 



TRIAL RUN 
FOR FIELD 
TEST PROCEDURES 



In an effort to increase the validity and reliability 
of the data collected during the field test, a piloting of 



the field test procedures was designed and implemented. In 
this trial run, a fifth grade unit (Unit 610) was delivered 
in two classrooms at each of the nine sites. The Department 
of Research and Evaluation then sent monitors to each of 
the sites to uncover any problems and also to gain insights 
into the field test procedures. They interviewed the field 
test coordinators, teacher of the pilot unit and witnessed 
the unit delivery in a classroom at each project. 

With minor revisions the field test procedures proved 
acceptable to all sites and the field test proceeded as 
scheduled. 



UNIT 
DISTRIBUTION 



During the period from November 1973 to May 1974 the 
fourteen career education curriculum units were field tested. 
The following listing shows the number of classrooms and 
corresponding units tested in each project. 
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STATEWIDE UNIT DISTRIBUTION 



NUMBER OF 



9 

ERIC 



PROJECT 


UNIT 
TESTED 


CLASSROOMS 
COMPLETED 


Coconino 


610 


2 




3768 


3 




3026 


2 




805 


3 




111 


3 




311 


• 

3 




210 


3 




605 


3 




709 


3 

Total » 25 


DICE 


3026 


2 




111 


1 




310 


2 




107 


1 

Total = 6 


Mesa 


610 


2 

• 




3768 


3 




811 


3 




111 


3 




210 


3 




611 


3 




211 


3 




107 


3 




709 


3 

Total ■ 26 
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STATEWIDE UNIT DISTRIBUTION 



PROJECT 


UNIT 
TESTED 


NUMBER OF 
CLASSROOMS 

COMPLETED 


Tri •county 


ai n 

D1U 






PI 1 
Oil 






DUD 






111 






611 


3 




107 


3 




605 


3 

Total - 20 




DlU 






3768 


3 




811 


3 


• 


611 


1 

Total » 9 


Yavapai 




- Z 




oil 


• 




BUS 


4 






•5 




•J1U 


A 
H 




01 A 
Z1U 






611 


4 




211 


4 




107 


5 

Total 2 
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STATEWIDE UNIT DISTRIBUTION 



PROJECT 


UNIT 
TESTED 


NUMBER OF 

CLASSROOMS 

COMPLETED 


Pxnal 


610 

« 


2 




3768 


2 


• 


3026 


3 




111 

www 


3 




311 

ww «A> 


3 




310 


3 




210 


2 


• 


211 


2 




605 


3 




709 

• 


3 

Total « 26' 


Roosevext 


610 

V w V 


2 




3768 


3 

w 


• 


805 

V W *r 


3 

• 




310 

V w V 


3 




611 


3 




2X1 






107 


2 




709 

• 


3 



Total ■ 22 
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STATEWIDE UNIT DISTRIBUTION 



NUMBER OF 



PROJECT 


UNIT 


CLASSROOMS 


Santa Cruz 


610 


2 




811 


2 




805 


2 




311 


1 




310 


1 

Total = 8 
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DATA COLLECTION 
AND 
ANALYSIS 









The field test is a large-scale multi-purpose use of 
the product, generating data to guide product installation 
and further refinements. The following list of objectives 
is presented as an indication of some of the major objectives 
guiding this field test: 

1. To examine product performance under large-scale 
conditions . 

2. To show under what conditions the product does or 
does not perform. 

3. To establish whether a product works without the 
supervision of its developers. 

4. To determine installation cost. 

5. To determine amount of time necessary for the 
product to achieve its objectives. 

6. To determine training requirements for school 
staff. 

7. To determine whether product is worthy of further 
investment. 

8. To provide product refinement data. 

9. To facilitate eventual widespread acceptance of 
the product. 

In an effort to answer as many of these outlined ob- 
jectives as operationally and logistically possible we 
defined the audience and/or contributors to career education. 
Four major population categories were defined: Learners, 
Business Community, Parents, and, of course, Teachers (Fig.l). 

ERIC " 



CO 



s 




s 
§ 

of: 

s 



on u 

UJ =) 
UJQ 



4f/ 



A/ 



,4r > "~ 



<<7 



0» 

Cm 



? g 



% 



9 

ERIC 



12 



Career education, in order to be a viable and eventually 
a permanent entry into the education system, must solicit 
input from these populations. 

From the learner, performance on the unit's objectives 
should be examined. In addition, it would be extremely im- 
portant in order to determine placement of the unit, to 
examine the characteristics of the students in relation 
to the unit's success. 

Learner attitude toward the unit, unfortunately rarely 
sought systematically by product developers, should be ex- 
amined as early in development as possible , High student 
interest or opposition should serve as a cue to developers 
that the product has hit the mark or needs major revisional 
work. 

At the classroom teacher's level is where acceptability, 
ease of use, curriculum conformance, vocabulary, and effec- 
tiveness with various kinds of students can be examined 
prior to implementation. 

The following information includes the kinds of data 
the teacher can generate and supply concerning the unit's 
effectiveness . 

1. Teacher attitude toward the unit 

i 

2. T eacher attitude toward career education 

3. Unit refinement information — classroom teacher 
comments concerning unit activities, objectives, 
evaluation items, etc. If general feelings about 
the unit are shared consistently by many teachers 
this will lead to unit refinement. 
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4. Teacher characteristics — here the intent is to 
examine if there was any relationship between 
teacher characteristics , such as teacher exper- 
ience, education, age, and success with career 
education units. 

5. Cost data — the teacher will provide information 
concerning cost of materials, activities, and time • 
to deliver unit. 

The remaining two contributors and/or audiences of 
career education (the parents and business community ) , 
may not directly affect the unit but by examining and comment- 
ing on the elements of career education, the goals, the de- 
livery strategies, or general concepts, they will affect 
the design of future units. Within the community surround- 
ing the school, some groups may be influential in determin- 
ing the fate of any new program. Interchange with repre- 
sentatives of such interest groups can assist in predicting 
community ciccepcance and in determining future program goals. 

Individuals from the bus. ness and parental community 
would fall under this capacity. It was found, as an example, 
that parental reaction to a new product may arise rather 

0 

slowly. It can however influence the maintenance and school 
use of the product and should be considered in program 
evaluation. 

We choose to examine the attitude, needs and alternative 
approaches toward career education for both of these com- 
munities. 

As a consequence of the above analysis, three major 
data gathering strategies were designed. 
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UNIVAL 



An instrument, (UNIVAL) , which was included within the 
curriculum unit package was designed to assist in gathering 
the basic data concerning the unit and "lessons directly. 

The unit and the UNIVAL booklet containing the evaluation 
instrument for the unit was delivered by the field test coor- 
dinator to the classroom teacher followed by an in-service 
session on the use and completion of the UNIVAL. 

The following data was collected within the UNIVAL: 

1. Learner unit Performance (Lesson Imbedded Test 
Items) 

2. Learner Attitude Toward Unit 

3. Learner Characteristics 

4. Teacher Attitude Toward Unit 

5. Teacher Attitude Toward Career Education 

6. Teacher Characteristics 

7. Cost Information 

UNIVAL data was collected from approximately 5,000 stu- 
dents and 175 teachers. 
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PANEL REVIEW 



Another major data gathering strategy that was used 
was the panel review. In this the main objective was to 
secure more detailed unit refinement data . 

The teachers having taught the unit were brought to- 
gether for a structured group session and discussed the 
unit's strengths and weaknesses. It was anticipated that 
discussion with the teachers would stimulate a more in- 
depth analysis of the unit. Career education in general 
and its educational values were also discussed. 



COMMUNITY REVIEW 



An ancillary technique was employed as our final data 
gathering strategy. The previous techniques were tied to 
the goals and objectives of the field test and directed 
toward the units. The Community Review techniques are not 
directly tied to the evaluation of the unit; however, the 
community, in this case business, parents, and teachers, will 
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be major users, acceptors, or detractors of subsequent pro- 
grams, and therefore must be represented in program design. 
The community review was made up of a group of teachers, 
parents and business representatives along with an inter- 
viewer from the Mesa project. The meeting had three 
major parts to it. First the participants filled out a 
questionnaire concerning career education. This was followed 
by a group structured interview by a member of the Mesa 
R and E staff, and finally, a free discussion period. The 
results of the community review are presented in a separate 
report in this series (Vol. 16) . 

The following table presents an overall summary of 
various data collection strategies and techniques employed 
in the field test. 



ERIC 



17 



DATA COLLECTION STRATEGY 



LEARNER PERFORMANCE 

PERCEPTION (UNIT) 

DEMOGRAPHICS 
TEACHER PERCEPTION (UNIT) 

PERCEPTION 

REFINEMENT DATA 

DEMOGRAPHICS 

COST DATA 
PARENTS PERCEPTION 

NEEDS 

* ALTERNATIVE APPROACHES 
BUSINESS PERCEPTION 
NEEDS 

ALTERNATIVE APPROACHES 



PANEL COMMUNITY 
UNIVAL REVIEW REVIEW 

X 

X 

X 

X X 

X X X 

X X 

X 

X 

X 
X 
X 
X 
X 
X 
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FIELD TEST RESULTS 
OVERALL UNIT REVIEW 



This section of the report presents the overall data 
summary and analysis for the field test. 

Significant summary statistics will be presented and 
discussed in the Field Test Results section of the report. 
Detailed statistical summaries for each unit are pre- 
sented in separate reports. An outline of this section 
follows : 

A. A description of the field test including demo- 
graphic characteristics of both participating 
teachers and students. 

B. Attitudinal data from both teachers and students 
concerning the units. * 

C. Learner performance data on the lesson specific 
items. 

D. Unit analysis data. 

E. Cost analysis data. 

F. Cost effectiveness data. 
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DESCRIPTION OF 
THE PARTICIPANTS 



The data in this report were obtained from the pro- 
jects , teachers, and learners described in the following 
tables. 

Table I presents the exact number of classrooms on 
which data were available in time for analysis. Originally 
it was anticipated that each unit would be presented in 
15 classrooms throughout the state. As in any large-scale 
field test, however, the projects encountered the usual 
number of problems completing the units on time and other 
unforeseen events. The resulting number, however, were 
sufficient enough to form the basis for valid decisions- con- 
cerning the units. 

TABLE I 

UNIT TITLES AND FIELD TEST CLASSROOMS 



UNIT 
107 



NUMBER OF 
TITLE CLASSROOMS 



What Do Workers Do? 14 

111 Careers Calling * 3 

210 Developing Your Potential H 

211 Ideas: Things to Think About 12 

310 The Future Me 13 

311 Now and Then 10 
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UNIT 



NUMBER OF 
TITLE CLASSROOMS 



ERIC 



605 Tools for Toil 9 

610 Giving and Following Directions 16 

611 Skill Schemes 14 

709 Doing Your Thing 12 

805 Reading, Writing and Numbering 15 

811 Look to Learning 14 

3026 Typing Correct Business Letters 7 

from Shorthand Dictation 

3768 Instructional Unit in Composition 14 

of Business Letters 

1. Learners 

Table II presents demographic information on the 
learners that were exposed to the career education 
units in the field test. A :total of approximately 
5,000 learners were exposed to the 14 curriculum 
units throughout the state. From Table II it can be 
noted that the learners' demographic characteristics 
represented the state fairly well. There was approxi- 
mately a 50/50 split on male-fjmale learners* The 
ethnic composition included slightly more minority 
representatives than the state population. The equiva- 
lent state figures are 20% Spanish, 70% Anglo, 4% Negro, 
6% Indian. 

Out of the students tested, 1,955 were representative 
of the minority backgrounds [1,134 (23%) Spanish Sur- 
name, 328 (7%) Negro, 470 (9%) American Indian, 23 
classified as other], and the remaining 3,003 (61%) were 
Anglo. 
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When the ethnic composition or profile of the 
various sites in the field test population are ex- 
amined we find varying patterns. The following table 
(Table III) exhibits an ethnic profile of each of the 
project's field test participants in terms of the 
field test means for each of the ethnic groups. 

TABLE III 
LEARNER ETHNIC COMPOSITION PROFILE 

DICE 

Mesa 

WACOP 

Yavapai 

Tri-County 

Coconino 

Pinal 

Roosevelt 

Santa Cruz 

+ significantly above field test mean. 
- significantly below field test mean. 
0 no different from field test mean. 

From Table III, it can be noted that DICE, Mesa, 
WACOP and Yavapai were represented at a lower than field 
test average percentage of American Indian, Negro and 
Spanish surname learners and a greater than average per- 
cent of Anglo students. 



American Spanish Anglo 

Indian Negro Surname White 



+ 
+ 

- - + 
0 0 0 

+ - o - 

+ - + - 

- + + - 

+ 



0 
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Tri-County's ethnic profile was closer to the 
average of the group with, however, a less than aver- 
age number of Negro students. 

Coconino showed a high profile in Indian students. 
Pinal showed a greater profile of Indian and Spanish 
rather than Negro and Anglo learners. On the other 
hand Roosevelt exhibited a higher profile of Spanish 
and Negro than Indian and Anglo learners. Santa Cruz 
had a greater profile of Spanish learners with lower 
than average Indian, Negro and Anglo populations. 

The diversity of profiles throughout the field 
test augurs well for learners' ethnic representation 
in the field test. This diversity can also assist 
other Arizona districts contemplating the use of the 
field tested career education units in implementation. 
Administrators from other districts could subject 
their district to the same technique of ethnic pro- 
filing as employed in this report, and by examining the 
various units* success in similarly profiled projects, 
could list priorities of unit implementation. This 
will be discussed further in the section on unit effec- 
tiveness. 
Teachers 

Table IV presents the total number and selected 
demographic characteristics of the teachers participating 
in the field test. 

It can be noted from Table IV that there were more 
than twice as many female teachers presenting the units 

24 



as male teachers. This is probably best explained by 
the fact that 12 out of the 14 units were elementary 
units. The median number of years of teaching exper- 
ience fell between 6-10 years. 

The teachers that presented the units in the field 
test appear fairly sophisticated concerning career 
education. Of the 174 teachers , 158 were familiar with 
career education, and of the 158, 41 previously taught 
a career education unit or program, and 37 had experi- 
ence in developing a career education unit or program. 



ATTITUDINAL DATA 



Teacher Attitude 

Included in each UNIVAL (Unit Evaluation Instrument) 
was an Instructor Attitudinal Data sheet which included 
two questions concerning attitudes toward career educa- 
tion in general, and 3 questions concerning the teacher's 
attitude toward the specific unit (see Appendix I)., 
a. Teacher Attitude Toward Career Education 

When we examine the teacher's general attitude 
toward career education (Table V) we find that the 
mean response across questions, units, and projects 
was 3.91, on a scale where 5 is the highest possible 

26 
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positive response. Of the 348 possible responses 
78% (273) were positive towards career education, 
16% (54) were of no opinion, and only 6% (21) were 
negative. There was little variability across 
projects. 

b. Teacher Attitude Toward the Units 

Table VI summarizes the teacher attitudes toward 
the units in the field test. 

The overall response to the units was a moderately 
positive 3.51. Of the possible 522 responses, 67% 
(351) were positive, 8% (41) were of no opinion, and 
25% (130) were negative. 

Teachers that had a high positive attitude 
toward career education appeared also to favor the 
units as reflected by Pearson's Product Moment co- 
efficient correlation of (r » 0.95) significant at 
and beyond the a = 0.01 level (Table VII). 

A preliminary examination of teacher comments 
and panel review inquiries reveals excessive length 
to be the most common and most severe criticism the 
units encountered. Thinking this observation to 
reflect a fundamental trend we correlated unit, 
length (estimated teaching time) with teacher atti- 
tudes toward specific units. 

The results were highly significant. The find- 
ings demonstrate that as a unit's length increases, 
the mean teacher attitudes toward the unit drop off 
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TABLE VII 



ALL UNITS 



MEAN TEACHER ATTITUDE TOWARD CAREER 
EDUCATION BY MEAN TEACHER ATTITUDE TOWARD THE UNITS 



UNIT 


TEACHER 
CAREER EDUCATION 
ATTITUDE 


TEACHER 
UNIT 
ATTITUDE 


107 


3.79 


3.40 


111 


3.62 


3.08 


210 


4.09 


3.91 


211 


3.96 


3.61 


310 


4.19 


3.56 


311 


3.90 


3.00 


605 


3.33 


3.56 


610 


4.06 


4.08 


611 


4.07 


3.81 


709 


3.71 


3.14 


805 


4.17 


3.58 


811 


3.75 


3.48 


3026 


4.07 


3.86 


3768 


3.93 


3.10 



CORRELATION COEFFICIENT » r - 0.95 
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sharply. This gives a correlation coefficient 
(r ■ -0.83) significant at and beyond 0.01 (Table VIII). 
c. Teacher Attitude and Experience 

When instructor experience is examined in relation 
to instructor attitude toward units, we find no signi- 
ficant differences in attitude for differing levels 
of instructor experience (Table IX) . 

Apparently teacher experience is not related 
to attitude toward the unit and administrators need 
not limit the distribution of career education units 
to instructors in a particular experience group. 

2. Learner Attitude 

When learner attitude toward the unit is examined, 
(Table X) , we see a fairly high positive feeling toward 
all units across all projects. Sixty- three percent of 
the 31,398 student responses were positive toward the 
unit, 25% no opinion, and 12% were negative toward the 
units. 

When the relationship between teacher and learner 
attitudes toward the units were examined (Table XI) , 
it was found that only a slightly positive relationship, 
as measured by the correlation, existed between the two 
(r » 0.26). An r of 0.46 is required for significance 
at and beyond the a - .10 level. It appears that teacher 
attitude toward the unit is not related to the student's 
attitude toward the unit. 
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TABLE VIII ALL UNITS 

Teacher Attitude and Unit Length (Time) 



UNIT 


T TXT T ITI 

UNIT 
LENGTH 
(TIME) 


TEACHER 
ATTITUDE 


211 ideas Things to Think About 


o nrs • 


3e 61 


/us Doing Your ming 


OA C 

ZO • 5 


O 1 it 
3e 14 


iu / wnat do wor Kers do 


i a 
10 


O il A 

3* 40 


oil Skill schemes 


^ _% 

10 


3. 81 


311 Now ana Then 


13* 2 


3e 44 


605 Tools for Toll 


i a 
10 


3e 56 


111 _4^V ______ - — ,_■__. _— ___ - — _^___ _Tw atftot 1 1 «Z ^» 

ill Careers calling 


18*5 


3. 08 


210 Developing Your Potential 


8 


A 1 

3. 91 


310 The Future Me 


8.75 


3.56 


811 Look to Learning 


11.5 


3.48 


805 Reading, Writing and Numbering 


9.5 


3.58 


610 Giving and Following Directions 


6 


4.08 


3768 Composition of Business Letters* 




3.10 


3026 Typing Correct Business Letters * 




3.85 



CORRELATION COEFFICIENT: r ■ -0.83 



*These units are designed to be flexible with freedom to vary 
length. 
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TABLE X 



ALL UNITS 



LEARNER ATTITUDE TOWARDS UNITS^ 
(Number , percent and Mean of Composite 
Learner Attitude Responses) 



PROJECT 


YES/HAPPY 
N % 


I DON'T 
CARE/OK 
N % 


NO/SAD 
N % 


MEAN 


Coconino 


1949 " 


54 


796 


22 


838 


24 


2.31 




617 


67 


209 


23 


98 


10 


2.56 


Mesa 


3132 


53 


1969 


33 


837 


14 


2.39 


Pinal 


3074 


66 


1159 


25* 


435 


9 


2.57 


Roosevelt 


3280 


74 


703 


16 


471 


10 


2.63 


Santa Curz 


783 


55 


425 


30 


*219 


15 


2.40 


Tri-County 


2767 


73 


718 


19 


317 


8 


2.64 


Wacop 


946 


56 


517 


31 


210 


13 


2.44 


Yavapai 


3207 


65 


1225 


25 


497 


10 


2.55 



Total 19755 63 7721 25 3922 12 
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TABLE XI 



ALL UNITS 



MEAN TEACHER ATTITUDE TOWARD THE UNITS BY 
MEAN LEARNER ATTITUDE 



TTMTT 


TEACHER 

Al IX J. UUxl* 


LEARNER 

AX X IXUUfi 


10 / 


^ An 


. 9 70 


111 


•a no 

JiUO 


O ^0 


zxu 


O • 7X 


£ « 34 


zxx 


£1 
O • Ol 


JO 


J±0 


3« Do 


9 C*7 


oXl 


J • uu 


a « jD 


bUD 


J • DO 


Z • / O 


610 


4.08 


2.61 


611 


3.81 


2.52 


709 


3.14 


2.58 


805 


3.58 


2.88 


811 


3.48 


2.34 


3026 


3.86 


2.29 


3768 


3.10 


2.07 



CORRELATION COEFFICIENT: r - 0.26 
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LEARNER PERFORMANCE 



In order to examine the learners 1 performance on the 
units, cumulative scores over all the lesson items were 
examined. Table XII presents the total learner scores in 
percentages for all the units by each project. 

The overall percent of correct scores for all the units 
by all the projects was a high 80%. There was little vari- 
ability across projects. This variability appears to be 
more related to the different units that were field tested 
rather than dependent on project site. 

Examining the relationship between learner attitude 
and learner performance (Table XIII) , it can be noted that 
a. slightly positive relationship exists between the two 
(r 88 0.26) . This correlation is not significant at the 
a ■ 0.10 level. Turning to the relationship between teacher 
attitude toward the unit and learner performance, we find a 
negative correlation (r ■ -0.38). That means that the more 
positively disposed the teachers were to the unit the poorer 
the learners performed. This surprising result gives rise 
to a number of possible hypotheses. The most probable being 
that the learner performances across units were fairly high 
and stable, so that it was difficult to discriminate between 
the teachers' attitudes toward the unit. 



3 

ERIC 



36 



TABLE XII 



ALL UNITS 



NUMBER AND PERCENT OF CORRECT LEARNER RESPONSES 
TO THE LESSON IMBEDDED ITEMS OF THE UNITS 



PROJECT 


NUMBER OF 
RESPONSES 


NUMBER OF 

CORRECT 
RESPONSES 


PERCENT OF 
CORRECT 
RESPONSES 


Coconino 


4868 


3866 


79 


DICE 


1421 


1142 


80 


Mesa 


6389 


5312 


83 


Pinal 


6761 


5374 


79 


nOOSevcXb 


DUOU 




iy 


Santa Cruz 


1965 


1646 


84 


Tri -County 


5626 


4383 


78 


WACOP 


1419 


1120 


79 


Yavapai 


7080 


5692 


80 


Total 


41589 


33331 


80 
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TABLE XIII ALL UNITS 

MEAN TEACHER ATTi'TUDE TOWARD THE UNITS AND 
MEAN LEARNER ATTITUDE TOWARD THE UNITS BY MEAN LEARNER PERFORMANCE 



ABC 



UNIT 


TEACHER ATT. 
TO UNIT 


LEARNER ATT. 
TO UNIT 


LEARNER 
PERFORMANCE 


107 


3.40 


2.70 ' 


80% 


111 


3.08 


2.52 


87% 


210 


3.91 


2.54 


92% 


211 


3.61 


2.38 


77% 


310 


3.56 


• 

2.57 


76% 


311 


3.00 


2.35 


79% 


605 


3.56 


2.76 


84% 


610 


4.08 


2.61 


72% 


611 


3.81 


2.52 


79% 


709 


3.14 


2.58 


86% 


805 


3.58 


2.88 


77% 


811 


3.48 


2.34 


78% 


3026 


3.86 


2.29 


41% 


3768 


3.10 


2.07 


82% 



CORRELATION COEFFICIENT: r = -0.38 

AC 

CORRELATION COEFFICIENT: r„„ =0.26 
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UNIT ANALYSIS 



When the major unit measures of effectiveness are examined 
they reduce to four major factors: Teacher attitude toward 
the unit, student attitude toward the unit, student perfor- 
mance in the form of lesson imbedded test items, and unit cost 
of implementation. 
1. Unit Effectiveness 

The following model was employed to combine the major 
measures of unit effectiveness to arrive at an overall 
unit value determination (Fig. 2). 

The first three measures gave us a good look at 
the effectiveness of the unit — in both the cognitive 
and affective modes. The units were then ranked in re- 
lation to this measure of e ffectiveness . 

This effectiveness ranking could, be utilized by 
school district administrators to assist them in choosing 
units to be implemented in their districts. The pro- 
spective users can examine the unit's effectiveness in 
projects with similar demographic characteristics as his 
own. In this way he can choose units that have a high 
probability of successful implementation and local accept- 
ance. To measure overall .cost effectiveness (UNIT VALUE), 
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rankings for teacher attitude, student attitude and 
student performance were given twice the weight as the 
cost of implementing the unit. The rankings with weights 
were then combined and re-ranked for overall cost effec- 
tiveness. So that a unit with high teacher attitude, 
high student attitude, successful student performance 
and low implementation cost would rank high on UNIT 
VALUE. The overall effectiveness ranking, along with 
rankings across units for teacher attitude, learner 
attitude and learner performance are presented in Table XIV. 

The fifth grade unit "Developing Your Potential" (210) 
ranked number 1 out of the 14 units with respect to unit 
effectiveness. The unit ranked 2, was a kindergarten unit 
entitled "Tools for Toil" (605). It should be noteA that 
with rankings we lose some information. A unit such as 
311, which exhibited the lowest ranking (14) was still 
a successful unit when one examines the actual scores. 
The teacher attitude had an average of 3, learner atti- 
tude 2.35 and learner performance 79%. At this point 
some ranking discrepancies can be noted and possibly 
explained. As an example, Unit 610, a fifth grade unit, 
showed that the teachers and learners enjoyed the unit 
(teacher ranked it 1, learners ranked it 4), but the 
learners did very poorly in the tests. It could be that 
the test items rfere difficult or that the unit is an 
excellent one, out should be delivered to the 6th grade. 
Another obvious discrepancy shows up with Unit 709 (4th 



9 

ERIC 



41 



TABLE XIV 



ALL UNITS 



OVERALL EFFECTIVENESS RANKING BY TEACHER ATTITUDE 
TOWARD THE UNITS, LEARNER ATTITUDE TOWARD THE UNITS, 

AND LEARNER PERFORMANCE 



UNIT 


GRADE 
LEVEL 


RANKING OF 
TEACHER ATT. 
TO UNIT 


RANKING OF 
LEARNER ATT. 
TO UNIT 


RANKING OF 

LEARNER 
PERFORMANCE 


OVERALL 
EFFECTIVENESS 
RANKING 


210 


5 


2 


7 


1 


1 


605 


K 


8 


2 


4 


2 


610 


5 


1 


4 


13 


3 


805 


K 


7 


1 


9 


4.5* 


107 


2 


10 


3 


6 


4.5* 


611 


6 


4 


8.5* 


7 


6 


709 


4 


13 


5 


3 


7 


111 


6 


12 


8.5* 


2 


8 


310 


5 


6 


6 

• 


12 


9 


211 


6 


5 


10 


10 


10 


3026 


10-12 


3 


13 


14 


11.5*. 


3768 


7-9 


11 


14 


5 


11.5* 


811 


6 


9 


12 


11 


13 


314 


6 


14 


11 


8 


14 



*tied ranks 



42 



grade) , where the learners liked the unit (rank of 5) 
and did well (rank of 3) but the teachers (rank of 13) 
did not care for the unit. Further examination of the 
unit showed that a considerable amount of monitoring 
and guidance work was required of the teacher in a part 
of the unit which required the building of a model of 
a house. The students enjoyed .this, the teachers however 
felt time and work pressures. In general, the rankings 

« 

give the reader an overall view of the units' success , 
but for any detailed analysis the individual reports on 
the units must be read (Vols 2-15) . 
Effectiveness and Ethnic Profile 

In an effort to assist future users of the unit, in 
terms of implementing units with higher probabilities of 
success within their own district, the following unit 
effectiveness rankings were computed for the various 
ethnic profiles represented in the field test (Tables XV 
through XX) . 

It must be noted at this time that not all units 
were tested within all projects. Therefore, a unit 
ray not be ranked within a particular ethnic profile 
because it was not tested within that specific profile. 
In that case we have no data concerning that unit's per- 
formance v» i thin the specific ethnic profile. This is 
not to say that it would not be successfully implemented 

« 

in such a district. The data here is presented only 
as a guide to implementation, and should not be used 
without examining the specific unit and the associated 
individual unit report recommendations. 
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TABLE XV ALL UNITS 





DICE, MESA, 


WACOP, 


YAVAPAI 






A. !♦ 


M 

Li • 


s.s. 


A. 

• • • 


ETHNIC 








+ 


PROFILE 













STUDENT 
ATTITUDE 
(SA) 


TEACHER 
ATTITUDE 
(TA) 


STUDENT 
PERFORMANCE 
(SP) 


EFFECT. 
RANK 


610 


1 


1 


9.5 


1 


210 


7 


4 


2 


2 


107 


2. 5 


•7 
/ 


c 


3 


111 


4 


11 


1 


4 


311 


6 


8 


3 


5 


709 


5 


10 


4 


6 

* 


611 


8 


3 


11 


7 


811 


11 


6 


6 


8 


805 


2.5 


13 


8 


9 


3026 


10 


2 


13 


10 


310 


9 


12 


7 


11 


211 


12 


5 


12 


12 


3768 


13 


9 


9.5 


13 
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TABLE XVI 
COCONINO 



ALL UNITS 





A.I. 


N. 


S.S. 


A. 


ETHNIC 


+ 




• 

0 




PROFILE 











' STUDENT TEACHER STUDENT EFFECT. 

UNITS ATTITUDE ATTITUDE PERFORMANCE RANK 
JSA) <TA) (SP) 



210 


2 


3 


1 


1 


610 


3 


1 


5 


2.5 


805 


1 


2 


6 


2.5 


709 


4 


5 


.2 


4 


3768 


8 


6 


3 


5 


3026 


5.5 


4 


9 


6 


605 


9 


7 


4 


7 


111 


5.5 


8 


8 


8 


311 


7 


9 


7 


9 
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TABLE XVII 
TRI-COUNTY 



ALL UNITS 





A.I. 


N. 


S.S. 


A. 


ETHNIC 


0 


mm 


0 


0 


PROFILE 











STUDENT TEACHER STUDENT EFFECT. 

UNITS ATTITUDE ATTITUDE PERFORMANCE RANK 
ISA) (TA) (SP) 

605 3 2.5 2.5 1 

107 2 2.5 4 2 

805 1 4.5 5 3 

611 4 4.5 2.5 y 4 

111 6 6 1 5.5 

610 5 1 .7 5.5 

811 7 7 6 7 



ERIC 



46 



TABLE XVIII 
SANTA CRUZ 



ALL UNITS 







A.I. 


N. 


S.S. 


A. 




ETHNIC 






+ 






PROFILE 


• 









UNITS 


STUDENT 
ATTITUDE 
(SA) 


TEACHER 
ATTITUDE 
(TA) 


STUDENT 
PERFORMANCE 
(SP) 


EFFECT. 
RANK 


805 


1 


2 


2 


1 


811 


2 


1 


s 


2 


310 


4 


5 


1 


3 


610 


3 


4 


4 


4 


311 


5 


3 


5 


5 

• 
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TABLE XIX 
PINAL 



ALL UNITS 





A* X • 


N. 


S.S. 


A. 


ETHNIC 


+ 




+ 




PROFILE 











UNITS 


STUDENT 
ATTITUDE 
(SA) 


TEACHER 
ATTITUDE 
(TA) 


STUDENT 
PERFORMANCE 
(SP) 


EFFECT. 
RANK 


605 


1 


2.5 


4 


1 


210 


4 


1 


3 


2 


709 


2.5 


9 


2 


3 


310 


5 


2.5 


8 


4 


610 


2.5 


5 


9 


5 


111 


8 


8 


1 


6 


311 


7 


6.5 


6 


7.5 


211 


6 


6.5 


7 


7.5 


3026 


10 


4 


10 


9.5 


3768 


9 


10 


5 


9.5 
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TABLE XX 
ROOSEVELT 



ALL UNITS 





A.I. 


N. 


S.S. 


A. 


ETHNIC 




+ 


+ 




PROFILE 











STUDENT TEACHER STUDENT EFFECT. 

UNITS ATTITUDE ATTITUDE PERFORMANCE RANK 
(SA) (TA) (SP) 



310 


2 


1 


3 


1 


610 


3 


2.5 


4 


2 


211 


7 


2.5 


2 


3 


3768 


8 


4 


1 


4 


611 


4.5 


5. 


5.5 


5.5 


805 


1 


7 


7 


5.5 


709 


6 


6 


5.5 

• 


7 


107 


4.5 


8 


8 


8 
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COST ANALYSIS 



ERIC 



To determine the total cost of implementing the unit and 
the total cost per student, 14 cost factors were used. 
Table XXI presents the cost factors with percentages and 
subtotals for all units in the field test combined. The 
mean per pupil cost per project was $4.63 and the total cost 
for implementing all units was approximately $21,000. When 
the 14 cost factors are examined we find that two factors, 
teaching time (64%) and teacher planning time (26%) , account 
for 90% of the cost of implementing the unit. In an in- 
vestigation of the ratio between preparation time and in- 
structional time, it was found that on the average a 
teacher spends approximately 2 minutes of preparation time 
for every 5 minutes of classroom instructional time. Wide 
variations in teachers 1 behavior were exhibited. Some 
teachers took much longer than others to complete the same 
units. In some cases there was considerable variation in 
the use of materials, field trips and other instructional 
aids. 

Since the majority of the cost of delivering the units 
can be attributed to the instructor's time, both in prepara- 
tion and implementation, the bulk of the unit's cost does 
not represent additional or new costs. Rather the cost is 
a part of regularly budgeted instructional and classroom 
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personnel expenses. It should also be emphasized that the 
career education units were not written exclusive of other 
curriculum concerns. Career education instructional units 
merely supplement already existing instructional programs. 

Table XXII presents the mean cost per learner of imple- 
menting units in the classroom along with their relative cost 
ranking. 



COST EFFECTIVENESS 



To determine the cost effectiveness ranking of the units , 
the rankings for teacher attitude, leemer attitude , and 
learner performance were given a ranking weight of 2, and 
cost a weight of 1. Since the predominant cost incurred 
by the units was in the area of teacher time, it was argued 
that this is a standing cost and as such it was deemed not 
as important in selecting a unit for implementation as 
teacher attitude, learner attitude, and learner performance. 
The cost effectiveness ranking is presented in the final 
column of Table XXIII. Again, Unit 210 "Developing Your 
Potential" receives the highest rank with Unit 605 "Tools 
for Toil" receiving a rank of 2. Unit 311, "Now and Then," 
again received the lowest rank. 
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TABLE XXII ALL UNITS 

RANKING OF THE MEAN COST PER LEARNER 
OF IMPLEMENTING THE UNITS IN TH1 CLASSROOM 



UNIT 


COST/LEARNER 


RANKING 


3768 


$ 1.98 


1 


610 


2.57 


2 


211 


3.29 


3 


3026 


3.49 


4 


605 


3.68 


5 


210 


4. n 7 


6 


107 


4.44 


7 


811 


4.90 


8 


611 


5.11 


9 


805 


5.27 


10 


310 


. 5.64 


11 


311 


5.97 


12 


709 


6.39 


.13 


111 


9.28 


14 



Mean Cost/Learner $4.63 



9 

ERIC 



53 



TABLE XXIII 



ALL UNITS 



OVERALL COST EFFECTIVENESS RANKING BY TEACHER ATTITUDE 
TOWARD THE UNITS # LEARNER ATTITUDE TOWARD THE UNITS, 
LEARNER PERFORMANCE AND COST PER LEARNER 



RANKING OF 
TEACHER ATT, 



RANKING OF 
LEARNER ATT. 



RANKING OF 
LEARNER 



55ST 

RANKING OF EFFECTIVE- 
COST/ NESS 



UNIT 


TO UNIT 


TO UNIT 


PERFORMANCE 


LEARNER 


RANKING 


210 


2 


7 


1 


6 


1 


605 


8 


2 


• 

4 


5 


2 


610 


1 


4 


13 


2 


3 


805 


7 


1 


9 


10 


4 


107 


10 


3 


6 


7 


mm 

5 


611 


4 • 


8.5* 


7 


9 


6 


211 


5 


10 


10 


3 


/ 


709 


13 


5 


3 


13 


8 


111 


12 


8.5* 


2 


14 


9.5* 


310 


6 


6 


12 


11 


9.5* 


3768 


11 


14 


5 


1 


11 


3026 


3 


13 


14 


4 


12 


811 


9 


12 


11 


8 


13 


311 


14 


11 


8 


12 


14 


* Units 


with the 


same score were 


given the average 


of the 


ranks for 



those scores. 
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SUMMARY 







1. A total of approximately 5,000 learners were exposed 
to the units in the nine participating projects. 
Fifty-one percent of the learners were female, and forty- 
nine percent male. Sixty-one percent of the learners 
were Anglo with thirty-nine percent from minority back- 
grounds. 

2. Of the 174 teachers that presented the units 54 were 
male and 120 were female. The median years of experience 
was between 6-10 years and 45 had previously taught or 
developed a career education unit or program. 

3. Teacher attitude toward career education was fairly high 
(3.91 on a scale where 5 was the highest possible re- 
sponse) . Of the 348 possible responses, 78% were posi- 
tive, 16% were of no opinion, and only 6% were negative. 

4. Teacher attitude toward the units — the teachers were 
moderately positive overall toward the units (3.51). 
Of the possible 522 responses, 67% were positive, 8% 
were of no opinion and 25% were negative. 

5. Teachers that had a high positive attitude toward career 
education appeared also to favor the units (r ■ .95). 
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6. Learner attitude was positive toward all units 
across all projects (2.5 on a scale where 3 was the 
highest possible response) . Sixty- three (63) percent 
of the 31. J98 student responses were positive toward 
the unit, 25% no opinion, and 12% were negative toward 
the unit. 

7. Learner performance on the unit — the overall percent 

of correct scores for all the units by all the projects 
was a high 80%. There was little variation across pro- 
jects. 

8. Measures of unit effectiveness based on teacher atti- 
tude toward the unit, learner attitude toward the unit, 
and learner performance on criterion referenced lesson 
imbedded items were calculated for each unit. A rank- 
ing of the units in terms of unit effectiveness is 
presented in the report. 

9. Student demographic data from the fiel* test site were 
subjected to an ethnic profile. The units' effective- 
ness were re-ranked in relation to ethnic profile, so 
that districts with comparable ethnic profiles could 
use the information for implementation decisions. 

10. Cost analysis— four co. e t actors were examined for each 
of the units. Two cost factors, teacher time and 
teacher planning time, account for 90% of the cost of 
implementing the unit. The mean per pupil cost per 
project was $4.63. 
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11. Unit effectiveness rankings (with double weight) and 
cost rankings (with single weight) were combined in 
order to re-rank the units in terms of a cost effec- 
tiveness measure called unit value. Rankings for each 
unit lor unit value are presented in the report. 



RECOMMENDATIONS 



1. All 14 units which were field tested are satisfactory 
enough to be included in the 1974-75 statewide imple- 
mentation program. 

2. It is recommened that an attachment containing sugges- 
tions for refinements, listed in the individual unit 
reports, be attached to the appropriate units for use 
by the implementation teachers. 
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APPENDIX I 
UNIVAL 



FIELD TEST INSTRUMENT PACKAGE 




Unit Evaluation 
UNIVAL 



INTRODUCTION 

This instrument is designed to gather information which 
will be used to help refine Career Education Curriculum Units. 
As the instructor, you are the most qualified individual to 
provide this ' information . It is important that while complet- 
ing the instrument, you are as specific as possible in suggest- 
ing improvements for the unit. Also, it is imperative that 
you teach the unit as it is so that the revision data obtained 
is consistently referring to the same unit and not one that 
is modified. 

Read over the entire instrument as soon as you receive 
it. Please complete Part I prior to teaching the unit. Parts II 
and III should be completed as you teach the unit, thus alle- 
viating the problems in recalling what actually took place. 
Part IV should be completed when you finish teaching the unit. 

If you need any assistance in the completion of the in- 
strument, please call your field test coordinator. 

Again, thank you for your part in this cooperative 
effort of developing a Career Education Program. 




PART I 
Descriptive Data 

Please Print ; 

Instructor School 

Unit title . _ District 

Grade level ; . Project_ 



Date unit introduced in the classroom 1— 

Mo. Day Year 

Date unit completed^ ^ L 



Mo. Day Year 
Students : (*The numbers should agree.) 

♦Total number of students exposed to the unit 

♦Number of students of each sex: a. Male b. Female 

♦Number of students in each ethnic group: 

a. American Indian d. Anglo White 

b. Black e - Other 

c. Spanish Surname . 

Teachers : 

How many years have you worked in the field of education? 

a. less than one a. 11-15 years 

b. 1-5 years e. more than if years 

c. 6-10 years 

Which one of the following would best describe year exposure 
to Career Education (bo date). I have 

a developed a Career Education Unit or program . 

b ! taught a Career Education Unit or poof •*» • 

c. read a Career Education Unit or program. 

d. had some exposure to Career Education • 

e . Tiad no exposure to Career Education * 

What is your sex? 

a. Male b. Female 



" PART II 
Uearner Performance Data. 



Directions : Please provide an indication of how well the 
lesson delivered the performance objectives. List each 
lesson number under the column indicated. If more than 
one item or method of evaluation was used for a lesson, 
please use separate lines to record the information. If 
the test items were used (e.g. multiple choice, essaj , 
true-false, completion items or interview items) place a 
check mark under test item. If a checklist was used, 
place a check mark under the column headed "Checklist." 
If no formal procedures were used to evaluate the learners, 
place a check mark under the column "Instructor Judgment." 
Indicate the total number of learners responding. Then 
record the number that responded correctly. Complete this 
form as you teach each lesson of the unit. 



SAMPLE 





Method of Evaluation 


Number of Learners 


Lesson 
Number 


Test 
Item 


Checklist 


Instructor 
Judgment 


Responding 


Responding 
Correctly 


(example) 
1 


#1^ 






28 


26 


1 


#2«^ 






28 


23 


2 








28 


28 


2 


#2 \S 






2f 


27 


3 










1 24 r 


4 










11 „ 


4 








26 


26 


? 








28 


27 



















































PART II (Continued) 





Method of Evaluation 


Number of Learners 


Lesson 
Number 


Test 
Item 


Checklist 


Instructor 
Judgment 


Responding 


Responding 
Correctly 






































































































• 












• 




• 


• 






• 






• 






• 


















• 














1 
































• 












• 
























• 


• 
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PART III 



Cost Analysis Data 



Inservice Training 

Indicate the amount of time you spent in workshops, orienta- 
tions and training sessions preparing to teach this unit. 
(Include travel time if done during your regular school day. 
This item is not to include the Career Education Workshops 
held by your Field Test Coordinator during which the UNIVAL 
instrument was explained*) 



Date 




/ 




/ 




Minutes involved 






MO. 




Day 




Year 






Date 




/ 




/ 




Minutes involved 






HO. 




Day 




Year 






Date 




/ 




/ 




Minutes involved 






Mo. 




Day 




Year 







Field T rips 



A. Destination 



Date 



Departure time_ 



Return time 



Mode of transportation 



Round trip mileage^ 



B. Destination 



Date 



Departure time 



Return time 



Mode of transportation 



Round trip mileage 



Additional Cost Items 

If you personally purchased any items to teach this unit, 
please list the item and the cost of the item. Such items 
may be marking pens, folders, wheat paste, books or any 
item essential to the lessons that you personally paid for. 

Item Cost 

Item Cost 

Item ; Cost ; 



Item 



Cost 
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PART IV 

f 



Instructor Attitudinal Data 

Directions: Read each statement and place a check in the box 
under the heading that describes your response. 





Strongly 
Agree 


Agree 


No 
Opinion 


Disagree 


Strongly 
Disagree 


Classes in my subject 
grade level would be 
more meaningful and rele- 
vant if focused around 
Career Education objec- 
tives . 












Career Education is just 
another fad that will 
soon be forgotten. 












After minimal revisions 
this unit will be 
ready for statewide 
distribution. 












The learning activities 
were very effective in 
helping meet the per- 
formance stated. 












The content of the unit 
relates directly to my 
regular class program. 













Indicate below any further comments concerning the strengths or 
weaknesses of the unit. 
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PART IV (Continued) 



Learner Attitudinal Data 



On the* following page is an attitudinal survey which 
we would like your learners to respond to. Please remove 
that page from this instrument and reproduce enough copies 
for each of your learners. We feel that it would be best 
if your learners responded to this survey at the completion 
of the unit. If your learners do not have the needed reading 
ability to complete the survey , please read and explain the 
items to them. After the learners have completed the survey, 
please tally their responses and record the total number of 
learners responding in each manner of the form provided 
below. 

YES I DON'T NO 

CARE 



1. 



2. 



3. 



4. 



HAPPY 



OK 



SAD 



5. 



6. 



7. 
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Learner's Name 



LEARNER UNIT ATTITUDINAL FORM 

Directions : Place a large "X" on the face which best shows 
how you feel. 



1. Would you want to know more 
about what we have learned 
in these lessons? 



2. Do you know more now about 
these lessons than before? 



3. Were the lessons interesting 
to you? 



4. Do you think that next year's 
class should be given these 
lessons? 



5. How did you feel about the 
lessons? 



6. How did most of your other 
classmates feel about the 
lessons? 



7. How did your teacher feel 
about the lessons? 
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ERIC 



YES I DON'T CARE NO 
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HAPPY OK SAD 
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